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Abstract. For a fixed countably infinite structure F with finite relational signature r, we 
study the following computational problem: input are quantifier- free r-formulas </>o, 01, . . . , 
that define relations Ro, Ri, . . . , R„ over F. The question is whether the relation Ro is prim- 
itive positive definable from Ri, . . . , R„, i.e., definable by a first-order formula that uses 
only relation symbols for Ri,...,Rn, equality, conjunctions, and existential quantification 
(disjunction, negation, and universal quantification are forbidden). 

We show decidability of this problem for all structures F that have a first-order definition in 
an ordered homogeneous structure A with a finite relational signature whose age is a Ramsey 
clciss and determined by finitely many forbidden substructures. Examples of structures F with 
this property are the order of the rationals, the random graph, the homogeneous universal 
poset, the random tournament, all homogeneous universal C-relations, and many more. We 
also obtain decidability of the problem when we replace primitive positive definability by 
existential positive, or existential definability. Our proof makes use of universal algebraic and 
model theoretic concepts, Ramsey theory, and a recent characterization of Ramsey classes 
in topological dynamics. 



1. Motivation and the Main Result 

When studying a countably infinite relational structure Q, we often wish to know what 
Q can express by its relations; for example, which other structures it interprets or defines. 
Concentrating on the latter, it would be pleasant to have an oracle which, given two structures 
0i;02 on the same domain, tells us whether they define one another. If all structures we 
are interested in have finite signature, this is the same as having an oracle which, given a 
structure Q and a relation R on the same domain, tells us whether R can be defined from 0. 

In this context, different notions of definability can be considered. The first notion that 
comes to mind is probably first-order definability: an n-ary relation R is first-order definable 
in Q iff there is a first-order formula (j){xi, . . . over the language for such that for all 
n-tuples a of elements in we have a G iff (p{a) holds. In some applications, however, 
other notions of definability, in particular syntactic restrictions of first-order definability, are 
useful. We will be concerned here with primitive positive definability: a first-order formula is 
called primitive positive iff it is of the form 3yi . . . 3ym- V'j where ip is a conjunction of atomic 
formulas; and an n-ary relation R is primitive positive definable over iff it is first-order 
definable in by means of a primitive positive formula (^(x^, • • • , ^n)* 

Primitive positive definability is of importance in the study of the constraint satisfaction 
problem for 0, denoted by CSP(0), in theoretical computer science. In such a problem, the 
input consists of a primitive positive sentence ip (that is, a primitive positive formula without 
free variables), and the question is whether ip is true in 0. Primitive positive definability 
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of relations in is important in the study of CSP(0) because the CSP for an expansion of 
B by relations that are primitive positive definable in B can be reduced (in linear time) to 
CSP(0). 

We will present here conditions under which the oracle which is to tell us whether a relation 
R has a primitive positive definition from a finite language structure B can be a computer, i.e., 
under which the problem is decidable. In order to make the problem suitable for an algorithm, 
we need a finite representation of the input of the problem, that is, the relation R and the 
structure B. Our approach is to fix a base structure T with finite relational language, and to 
assume that both R and B have a quantifier- free definition in T. We then represent R and 
B as quantifier- free formulas over T. Therefore, the input of our problem are quantifier- free 
formulas cpo, . . . ,(j)n in the language of T, of which (pQ defines the relation R, and cpi, . . . jCpn 
define the relations Ri,...,Rn of B; the question is whether there is a primitive positive 
definition of (j)o that uses only relation symbols for Ri, . . . , Rn- We denote this computational 
problem by Exprpp(r). 

An algorithm for primitive positive definability has theoretical and practical consequences 
in the study of the computational complexity of CPSs. On the practical side, it turns out 
that hardness of CSP(B) can usually be shown by presenting primitive positive definitions of 
relations for which it is known that the CSP is hard. Therefore, a procedure that decides prim- 
itive positive definability of a given relation is a useful tool to determine the computational 
complexity of CSPs. 

For the simplest of countable structures, namely the structure {X; =) having no relations 
but equality, the decidability of Exprpp(r) has been stated as an open problem in [3]. We 
will show here decidability of Exprpp(r) for a large class of structures F which we will now 
define. 

Let r be a finite relational signature. The age of a r-structure A is the class of all finite 
r-structures that embed into A. We say that a class C of finite r-structures, and similarly a 
structure with age C, is 

• finitely hounded (in the terminology of jT^) iff there exists a finite set of finite r- 
structures J- such that for all finite r-structures A we have A € C iff no structure 
from T embeds into A] 

• Ramsey iff for all /c > 1 and for all H,P £ C there exists S £ C such that S (H)^ , 
i.e., for all colorings of the copies of P in 5 with k colors there exists a copy of H in 
S on which the coloring is constant (for background in Ramsey theory see [12j); 

• ordered iff the signature r contains a binary relation that denotes a total order in 
every A £ C. 

A structure is called homogeneous iff all isomorphisms between finite induced substructure^ 
extend to automorphisms of the whole structure. A structure F is called a reduct of a structure 
A with the same domain iff all relations in F are first-order definable in A. We will prove the 
following. 

Theorem 1. Let A be a structure which is ordered, homogeneous, Ramsey, finitely bounded, 
and has a finite relational signature. Then for any reduct T of A with finite relational signature 
the problem Expr (F) is decidable. 



In this article, substructures are always meant to be induced; see [14| . 
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We remark that for finite structures T the problem Exprpp(r) is in co-NEXPTIME (and 
in particular decidable). For the variant where the finite structure T is part of the input, the 
problem has recently shown to be also co-NEXPTIME-hard [23]. 

Note that since A is homogeneous, it has quantifier elimination, i.e., every relation which is 
first-order definable in A can be defined by a quantifier-free formula. Hence, choosing F = A, 
we see that our requirement for the relations in Exprpp(F) to be given by quantifier- free 
formulas does not restrict the range of relations under consideration. 

Examples of structures A that satisfy the assumptions of Theorem [1] are (Q; <), the Frai'sse 
limit of ordered finite graphs (or tournaments [iSj), the Frai'sse limit of finite partial orders 
with a linear extension [18j, and the homogeneous universal 'naturally ordered' C-relations. 
(For definition and basic properties of C-relations, see [Ij, in particular Theorem 14.7. The 
fact that the homogeneous universal naturally ordered C-relations have the Ramsey property 
follows from Theorem 4.3 in [T7j; an explicit and elementary verification of the Ramsey 
property for the binary branching case can be found in [?].) CSPs of reducts of such structures 
are abundant in particular for qualitative reasoning calculi in Artificial Intelligence. For 
instance, our result shows that it is decidable whether a given relation from Allen's Interval 
Algebra [2l[22] is primitive positive definable in a given fragment of Allen's Interval Algebra. 

As mentioned above, for F = (X; =), the decidability of Exprpp(F) has been posed as an 
open problem in [3J. Our results solve this problem, since {X;=) is definable in A := (Q; <), 
which is ordered, homogeneous, Ramsey, and finitely bounded: the Ramsey property for 
this structure follows from the classical Ramsey theorem, and the other properties are easily 
verified. 

Using similar methods, decidability of the analogous problem for other syntactic restrictions 
of first-order logic can be shown in the same context. A formula is called existential iff it is 
of the form 3yi . . . 3ym- V'; where ■0 is quantifier-free. It is called existential positive iff it is 
existential and does not contain any negations. For a r-structure F, we denote by Exprg^(r) 
(Exprgp(F)) the problem of deciding whether a given quantifier- free r-formula (po has an 
existential (existential positive) definition over the structure with the relations defined by 
given quantifier- free r-formulas 0i, . . . , (/>n in F. 

Theorem 2. Let A be a structure which is ordered, homogeneous, Ramsey, finitely bounded, 
and has a finite relational signature. Then for any reduct T of A with finite relational signature 
the problems Exprgx(F) and Exprgp(F) are decidable. 

The assumptions on A in our theorems fall into two classes: the conditions of being ordered, 
homogeneous, Ramsey, and having finite relational signature imposed on A generally allow 
for a relatively good understanding (in a non-algorithmic sense) of the reducts of A. The 
recent survey paper [9] summarizes what we know about reducts of such structures - their 
exciting feature is that many branches of mathematics, including model theory, combinatorics, 
universal algebra, and even topological dynamics are employed in their study, and indirectly 
also in our algorithm. The additional condition of being finitely bounded is needed to represent 
A algorithmically. 

This paper is organized as follows. In Section [2] we show that the assumption of A being 
finitely bounded is necessary for our decidability result. We then turn to the proof of The- 
orems [1] and [2j in Section [3] we cite preservation theorems of the form "ii is definable from 
O (in some syntactically restricted form of first-order logic) if and only if certain functions 
on the domain of Q (which functions depends on the syntactic restriction) preserve R" . Sec- 
tion m is devoted to the use of Ramsey theory in order to standardize functions that do not 
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preserve R- if such functions exist. Our decision procedure, presented in Section [5l then uses 
this standardization of functions and the preservation theorems to check whether or not R is 
definable from 0. The paper ends with two sections containing further discussion and open 
problems. 

2. Undecidability of Definability 

This section demonstrates that the assumption in Theorem [2] of A being finitely bounded is 
necessary. We use a class of homogeneous digraphs introduced by Henson [13] . A tournament 
is a directed graph without self- loops such that for all pairs x,y of distinct vertices exactly one 
of the pairs {x, y), (y, x) is an arc in the graph. For a set of finite directed graphs M, we write 
Forb(7\A) for the class of all finite directed graphs that do not embed one of the structures 
from J\f. For all sets of finite tournaments there exists a countably infinite homogeneous 
directed graph F with age Forb(A/') (this can be shown by amalgamation, see [Hj). Moreover, 
those properties characterize F up to isomorphism. Henson specified an infinite set T of finite 
tournaments Ai, A2, . . . with the property that Aj does not embed into Aj if i ^ j; the exact 
definition of this set is not important in what follows. But note that for two distinct subsets 
Ml and J\f2 of T the two sets Forb(A/i) and Forb(A/'2) are distinct as well, and so are the 
respective homogeneous digraphs with age Forb(A/i) and Forb(A/'2). Since there are 2"^ many 
subsets of the infinite set T, there are also that many distinct homogeneous directed graphs; 
they are often referred to as Henson digraphs. 

Proposition 3. There exists a ordered directed graph A which is homogeneous and Ramsey 
such that Exprpp(A) and Exprgp(A) are undecidahle. 

Proof. For any Henson digraph F, the class C of all expansions of the structures in the age 
of F by a linear order is a Ramsey class; this can been shown by the partite method |19j . 
Moreover, there exists a homogeneous ordered digraph A with age C (again by amalgamation, 
see [H]), and F is a reduct of A. 

We show that non-isomorphic Henson digraphs Fi and F2 have distinct Exprpp problems. 
In the following, let E denote a binary relation symbol that we use to denote the edge relation 
in graphs. In fact, we show the existence of a first-order formula over digraphs such that the 
input := E{x,y) and (pi is a yes-instance of Exprpp(Fi) and a no-instance of Exprpp(F2), 
or vice- versa. Since there are uncountably many Henson digraphs, but only countably many 
algorithms, this clearly shows the existence of Henson digraphs F such that Exprpp (F) is 
undecidable. This finishes the proof since F is a reduct of an ordered homogeneous Ramsey 
structure A, as we have seen above, and Exprpp (A) must be undecidable as well. The same 
argument shows undecidability of Exprgp(A). 

By the definition of Fi and F2, there exists a finite digraph Q which embeds into Fi but 
not into F2, or that embeds into F2 but not into Fi. Assume without loss of generality the 
former. Let s be the number of elements of fi, and denote its elements by ai, . . . , a^. Let ip 
be the formula with variables xi, . . . ,Xs that has for distinct i,j < s a conjunct E{xi,Xj) if 
E{ai,aj) holds in fi, and a conjunct -^E{xi,Xj) A Xj / Xj otherwise. Let cpi be the formula 

Ip A E{Xs+l,Xs+2)- 

Let Di be the domain of Fi, and consider the relation Ri C (Dx)'*^^ defined by cpi in Fi. 
Let i? be a relational symbol of arity s + 2. Let B be the structure with signature {R}, domain 
Di, and where R denotes the relation Ri. It is clear that 3xi, . . . ,Xs. R{xi, ... ,Xs,x,y) is a 
primitive positive definition of E{x, y) in Q. 
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Now consider the relation R2 defined by (pi in r2 over the domain D2 of Since 0, does 
not embed into the precondition of 4>i is never satisfied, and the relation R2 is empty. 
Hence, the relation E{x, y) is certainly not first-order (and in particular not primitive positive) 
definable in (1)2; -^2)- D 

3. Preservation Theorems 

Let r be a reduct of a homogeneous finitely bounded Ramsey structure A with finite 
relational signature. Our algorithm for Exprpp(r) is based on the fact that if R is not 
definable from 0, then there exists a certain kind of function which violates R] in order to 
decide whether or not R is definable, the algorithm thus searches for such a function. In this 
section, we shall formulate this fact in more detail. 

A structure is called uj- categorical iff its first-order theory has exactly one countable model 
up to isomorphism. For an n-tuple a of elements of a structure A, the type of a is the set of 
all first-order formulas with n free variables xi, . . . , that are satisfied by a. By a theorem 
of Ryll-Nardzewski (see for example the textbook [14]), a structure is (^-categorical iff it has 
only finitely many different types of n-tuples (called n-types), for each n > 1. From this 
characterization it is straightforward to see that structures which are homogeneous and have 
a finite relational signature are w-categorical; in particular, this is true for the structure A 
of Theorems [1] and [2j For an n-tuple a of elements of a structure A, the orbit of a is the set 
{a(a) : a € Aut(A)}, where Aut(A) denotes the automorphism group of A. It is well-known 
that a structure is (^-categorical iff it has for every n > 1 only finitely many orbits of n-tuples 
(called n-orhits). Moreover, in w-categorical structures two n-tuples have the same type iff 
they have the same orbit (see again [H]). In particular, every n-ary relation definable over 
an w-categorical structure is a finite union of orbits of re-tuples. 

Clearly, when G is a reduct of a structure A, then Aut(0) ^ Aut(A). Hence, if A is uj- 
categorical, then so is G; therefore, all structures that appear in this paper are w-categorical. 

If R is an rre-ary relation on a set D, and / : — > is a finitary operation on D, then we 
say that / preserves R iff /(ri, . . . ,r„) (calculated componentwise) is in R for all m-tuples 
ri, . . . ,r„ € R. In other words, when = [r], . . . ,rf^) € R for all i < n, we require that 
(/(r|, . . . , r^), . . . , f{r^, . . . , r^^)) G R. Otherwise, we say that / violates R. Observe that a 
permutation a acting on the domain of a structure G is an automorphism iff both a and its 
inverse preserve all relations of G. An endomorphism of a structure G with domain D is a 
unary operation f : D D which preserves all relations of Q. A self-embedding of Q is an 
injective unary operation f : D —?■ D which preserves all relations of G and all complements 
of relations in Q. A polymorphism of Q is a finitary operation /: D" — )• D which preserves 
all relations of Q. 

We can now state the preservation theorem used by our algorithm. Statement (1) is 
well-known in model theory and follows from the standard proof of the theorem of Ryll- 
Nardzewski. Items (2) and (3) are consequences of the Theorem of Los-Tarski and the 
Homomorphism Preservation Theorem; for these theorems, see [H], for the (straightforward) 
proofs of statements (2) and (3) see [8j. Item (4) is due to Bodirsky and Nesetfil [6]. 

Theorem 4. Let G be an uj- categorical structure, and let R he a relation on its domain. 

(1) R has a first- order definition in Q iff R is preserved by all automorphisms of Q. 

(2) R has an existential definition in Q iff R is preserved by all self- embedding s of Q. 

(3) R has an existential positive definition in Q iff R is preserved by all endomorphisms 
o/G. 



6 



MANUEL BODIRSKY, MICHAEL PINSKER, AND TODOR TSANKOV 



(4) R has an primitive positive definition in Q iff R is preserved by all polymorphisms of 

e. 

4. Standardizing Functions 

Theorem S] tells us that if a relation R is not definable in an w-categorical structure 0, then 
this is witnessed by a some finitary function on the domain of G; the kind of function depends 
on the notion of definability. In this section, we show that in the context of Theorems [T] and O 
this is even witnessed by a function which shows a certain regular behavior, making the search 
for such an (infinite!) function accessible to algorithms. We start by defining what we mean 
by regular behavior. 

4.1. Canonicity. 

Definition 5. For a structure A and n > 1, we write for the set of all n-types in A. The 
cardinality of is denoted by o'^(n). We write 5^ := Un>i '^n- ^'^^ n-tuple a G A, we 
write tp^(a) for the element of corresponding to a. We drop the reference to the structure 
in this notation when the structure is clear from the context. 

Definition 6. A type condition between two structures H and is a pair (s, t), where s £ 5,^ 
and t G S*^ for the same n > 1. A function / : H — > satisfies a type condition {s,t) iff for 
all n-tuples a = (ai, . . . , a„) in H of type s, the n-tuple /(a) = (/(ai), . . . , f{an)) in Q. is of 
type t. 

A behavior is a set of type conditions between two structures. A function has behavior B 
iff it satisfies all the type conditions of the behavior B. For n > 1, a behavior B is called 
n-complete iff for all types s £ there is a type t € 5^ such that (s, t) € B. It is called 
complete iff it is n-complete for all n > 1. 

A function / : S — >• O is canonical (n-canonical) iff it has a complete (n-complete) behavior. 

For F C H we say that / satisfies a type condition {s, t) on F iff for all n-tuples a = 
(ai, . . . ,a„) in F of type s (in H, not in the substructure induced by F), the n-tuple /(a) = 
(/(ai), . . . , /(on)) in Q. is of type t. The notions of having a behavior on F and of being 
canonical on F are then defined naturally. 

Observe that a complete behavior is just a function from to which respects the 
sorts, i.e., n-types are sent to n-types. We remark that not every such function is necessarily 
the behavior of a canonical function from H to but every canonical function from H to O 
does define a function from to S^. A behavior is just a partial function from to 
respecting the sorts. 

Definition 7. For a relational structure A, we write n(A) for the supremum of the arities of 
the relations of A. 

Suppose that n(H) is finite and that S has quantifier elimination^ i.e., every first-order 
formula in the language of H is equivalent to a quantifier- free formula over H; this is in 
particular the case for the structure A of Theorems [1] and [21 since homogeneity implies 
quantifier elimination. Then the type of any tuple in H is determined by the types of its 
subtuples of length n(H). If moreover the same condition holds for i7 (in particular, if i7 = H), 
and we set n to be the maximum of n(H) and n(J7), then a total function from to 
automatically defines a total function from to S^. In other words, a function /: H — t- O is 
canonical iff it is n-canonical. Note also that is finite for every k>\ since H is w-categorical 
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(this follows if H has quantifier elimination and finite relational signature, cf. [H]). Therefore, 
canonical functions can be represented by finite objects, namely by functions from to S*^. 
Since Q is w-categorical as well, there are only finitely many functions from to S^, and 
hence there exist only finitely many complete behaviors between H and fi, allowing to check 
all of them in an algorithm. Roughly, our goal in the following is to prove that functions 
witnessing that a relation R is not definable in can be assumed to be canonical; it will turn 
out that this is almost true. 

4.2. Calling Ramsey. 

Lemma 8. Let H be ordered Ramsey, let be uj -categorical, and let f : 'B be a function. 
Then for all finite substructures F C H there is a copy of F inE on which f is canonical. 

Proof. Set n := n(H), and let m := o^{n). Now / defines a coloring of the n-tuples in H by 
m colors: the color of a tuple a is just the type of /(a) in Q. Note that if P, S are ordered 
structures, then coloring copies of P in 5 is the same as coloring tuples of type tp{p), where 
p is any tuple which enumerates P - this is because every copy of P in 5 contains precisely 
one tuple of type tp{p), and every tuple of type tp(p) in S induces precisely one copy of P in 
S. 

Given any finite substructure F of S, enumerate all types of n-tuples that occur in F by 
ti, . . . ,tk. There is a substructure 5i of H such that whenever all tuples of type ti in Si are 
colored with m colors, then there exists a substructure Hi of 5*1 isomorphic to F on which the 
coloring is constant. Further, there is a substructure 52 of H such that whenever all tuples of 
type t2 in S2 are colored with m colors, then there exists a substructure H2 of 5*2 isomorphic 
to 5*1 on which the coloring is constant. We iterate this k times, arriving at a structure S^. 
Now going back the argument, we find that S'fc contains a copy of F on which all colorings 
are constant. That means that / is canonical on this copy. □ 

We remark that this lemma would be false if one dropped the order assumption. 

We will now use Lemma [8] in order to show that for ordered homogeneous Ramsey struc- 
tures A with finite relational signature, arbitrary functions from A to A generate canonical 
functions from A to A. To introduce this notion, we make the following observation. The set 
End(A) of endomorphisms of a structure A forms a transformation monoid, i.e., it is closed 
under composition fog and contains the identity function id. Moreover, it is closed (also 
called locally closed or local) in the topological sense, i.e., it is a closed subset of the space 
D^, where D is the domain of A equipped with the discrete topology. This implies that if a 
set F of functions from D to D preserves a set of given relations, then so does the smallest 
closed monoid containing F. This motivates the following definition. 

Definition 9. Let D be a set, g : D ^ D, and let be a set of functions from D to D. We 
say that F generates g iS g is contained in the smallest closed monoid containing F. For a 
structure A with domain D and a function / : D — t- D, we say that / generates g over A iff 
{/} U Aut(A) generates g. Equivalently, for every finite subset F of A, there exists a term 
ao o (/ o «! o • • • o / o an), where n > and G Aut(A) for < i < n, which agrees with g 
on F. 

Note that every operation f : D —?■ D generates an operation g over A that is canonical as a 
function from A to A, namely the identity operation. What we really want is that / generates 
over A a canonical function g which represents / in a certain sense - it should be possible to 
retain specific properties of / when passing to the canonical function. For example, when / 
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violates a given relation R, then we would like to have a canonical g which also violates R - 
this is clearly not the case for the identity function. Unfortunately, / might be such that it 
violates a relation R without generating any function that is canonical as a function from A 
to A and that violates R. 

We therefore have to refine our method: we would like to fix constants ci, . . . , c„ G A which 
witness that / violates R and then have canonical behavior relative to these constants, i.e., 
on the structure (A, ci, . . . , c^) which is A enriched by the constants ci, . . . , c^. In order to 
do this, we must assure that (A, ci, . . . , c^) still has the Ramsey property. This leads us into 
topological dynamics. 



4.3. An escapade in topological dynamics. The goal of this subsection is to show the 
following proposition by using a recent characterization of the Ramsey property in topological 
dynamics. 

Proposition 10. Let A be ordered homogeneous Ramsey, and let ci,...,Cn G A. Then 
(A, ci, . . . , c„) is ordered homogeneous Ramsey as well. 

We remark that it is easy to see that the expansion of any homogeneous structure by 
finitely many constants is again homogeneous, and that the nontrivial part of the proposition 
concerns the Ramsey property. We do not know if the same proposition holds if one does not 
assume A to be ordered. 

To prove the proposition, we use a theorem from [15j. A topological group is a group (G; •) 
together with a topology on G such that (x, y) i-^- xy~^ is continuous from to G. A group 
action of G on a topological space X is continuous iff it is continuous as a function from 
G X X into X. 

Definition 11. A topological group is extremely amenable iff any continuous action of the 
group on a compact Hausdorff space has a fixed point. 

Theorem 12 (Kechris, Pestov, Todorcevic [E]). An ordered homogeneous structure is Ram- 
sey iff its automorphism group is extremely amenable. 

Thus the automorphism group of the structure A in Proposition [10] is extremely amenable. 
Note that the automorphism group of (A,ci, . . . ,c„) is an open subgroup of Aut(A). The 
proposition thus follows from the following fact. 

Lemma 13. Let G be an extremely amenable group, and let H be an open subgroup of G. 
Then H is extremely amenable. 

Proof. Let H act continuously on a compact space X; we will show that this action has a 
fixed point. Denote by H\G the set of right cosets of H in G, i.e. H\G = {Hg : g € G}. 
Denote by tt: G — )• H\G the quotient map and let s: H\G G he a, section for vr (i.e., a 
mapping satisfying vr o s = id) such that s{H) = 1. Let a be the map from H\G x G ^ H 
defined by 

a{w,g) = s{w)gs{wg)~^ . 
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For w € H\G and g (z G, note that s{w)g and s{wg) lie in the same right coset of H, namely 
wg, and hence the image of a is H. The map a satisfied 

a{w,gig2) = s{w)gig2{s{wgig2)y^ 

= s{w)gis{wgi)s{wgiy^g2{s{wgig2))~'^ 

= o:{w,gi)a{wgi,g2) ■ 

As H is open, H\G is discrete. Hence, s is continuous, and therefore a is continuous as 
a composition of continuous maps. The co-induced action G r\ X^^^ of G on the product 
space X^\'^ is defined by 

{a ■ i){w) = a{w,g) ■ (,{wg). 
To check that this action is continuous, it suffices to see that the map (5,^) 1— t- {g ■ Oi"^) is 
continuous G x X^\^ — )■ X for every fixed w € H\G. We already know that a is continuous 
and that the action H r\ X is continuous. To see that (g, ^) 1-^ S.i'wg) is continuous, suppose 
that (gm^n) — ^ (5)0- Let w = Hk. As 5 and k~^Hk is open, we will have that 

eventually gng~^ G k^^Hk, giving that kgn{kg)~^ G H, or, which is the same, Hkgn = Hkg. 
We obtain that for sufficiently large n, wgn = wg. Therefore iniwgn) — >• (,{wg)- 

By the extreme amenability of G, this action has a fixed point ^o- Now we check that 
^o{H) G X is a fixed point of the action H r\ X. Indeed, for any h ^ H, h ■ = and we 
have 

io{H) = {h ■ Co){H) = a{H, h) ■ UHh) = h ■ Co{H), 
finishing the proof. □ 

4.4. Minimal unary functions. Using Proposition \T0\ we can now prove a 'canonisation 
lemma' that will be central in what follows. 

Lemma 14. Let A be ordered homogeneous Ramsey with finite relational signature, f : A 
A, and let ci,...,c„, € A. Then f generates over A a function which agrees with f on 
{ci, . . . , c„} and which is canonical as a function from (A, ci, . . . , c„) to A. 

Proof. Let (-Fj)jg^ be an increasing sequence of finite substructures of (A, ci, . . . , c„) such that 
UiGoj ~ ci, • • • , Cn). By Lemma[8l for each i £ lj we find a copy of Fi in (A, ci, . . . , c„) 
on which / is canonical. By the homogeneity of (A, ci, . . . , c„,), there exist automorphisms a, 
of (A, ci, . . . , Cn) sending Fi to F/, for all i £ oj. Since there are only finitely type conditions 
for n((A, ci, . . . , c„))-tuples, we may assume that if / satisfies a type condition on F^, then it 
satisfies the same type condition on -Fi+i. Then we can inductively pick automorphisms /3j of 
(A, ci, . . . , Cn) such that /3i+i 0/0 a^+i agrees with f oa-i on F,, for all i G uj. The union 
over the functions /3j o / o aj : Fj ^ A is a canonical function from (A, ci, . . . , c„) to A. □ 

The set of all closed transformation monoids on a fixed domain D forms a complete lattice 
with respect to inclusion; it is the lattice of all endomorphism monoids of structures with 
domain D. Lemma O has the following interesting consequence for this lattice. 

Definition 15. Let J\f, A4 be closed monoids over the same domain. We say that J\f is 
minimal above Ai iS A4 C^J\f and A4 TZ Q J\f implies TZ = N for all closed monoids TZ. 

Clearly, every minimal monoid above Ai is generated by a single function together with 
M.] such functions are called minimal as well (cf. [8]). 



Such maps are called cocycles, and the given identity is called the cocycle identity. 
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Lemma 16. Let Q be a structure with a finite relational signature which is a reduct of an 
ordered homogeneous Ramsey structure A in a finite relational signature, and let M he a 
minimal closed monoid above End(0). Then there exist constants ci, . . . , c„(0) € A and 
a function f which is canonical as a function from (A,ci, . . . ,c„(e)) A such that M is 
generated by End(0) and f. 

Proof. Pick any g J\f \ End(0). Since g ^ End(B), there exist a relation i? of and a 
tuple c := (ci, . . . , c„(e)) such that R is violated on this tuple. By Lemma [HI g generates a 
function / over A which is canonical as a function from (A, ci, . . . , c„(e)) to A and which is 
identical with g on {ci, . . . ,Cn(e)}- Then / and End(©) generate M. □ 

Proposition 17. Let Q be a finite relational signature reduct of an ordered homogeneous 
finite relational signature Ramsey structure A. Then there are finitely many minimal closed 
monoids above End(0), and every closed monoid containing End(G) contains a minimal one. 

Proof. Observe that if c,d are tuples of the same type in A, and f,g are canonical functions 
from (A,c) and (A,(i) to A, respectively, and their (complete) behaviors are identical, then 
/ and g generate one another over A. Thus, there are only finitely many inequivalent (in 
the sense of 'do not generate one another') functions generating minimal monoids. The 
upper bound for minimal monoids is the following: set j := o^(n{Q)) (there are that many 
inequivalent choices for the tuple of constants of length n{Q) in A). For every type of an 
rz(0)-tuple c in A, set Tc := o^'^'^\n{A)). Set r to be the maximum of the rc. Define moreover 
s := o^(n(A)). Then a bound for the number of inequivalent minimal functions over End(G) 
is j ■ s"^. □ 

4.5. Minimal higher arity functions. Since primitive positive definability is characterized 
by finitary functions rather than unary functions (recall Theorem U]) , we have to generalize 
our method to higher arities. 

Definition 18. Let Hi, ... , be a structures. For a tuple x in the product Hi x • • • x Hm, 
and 1 < i < m, we write Xi for the i-th coordinate of x. The type of a sequence of tuples 
a^, . . . , a" G Hi X • • • X H^, denoted by tp(a^, . . . , a"), is the m-tuple containing the types of 
{aj, . . . , a") in Hj for each 1 < i < m. 

With this definition, also the notions of type condition, behavior, (n-)complete behavior, and 
(n-)canonical generalize in complete analogy from functions /: H — )■ fi, where H is a "normal" 
structure, to functions /: Hi x • • • x H^ — > ^ whose domain is a product. It is folklore that 
the Ramsey property is not lost when going to products; for the reader's convenience, we 
provide a proof here. 

Lemma 19 (The ordered Ramsey product lemma). Let Hi, . . . ,Hm be ordered and Ramsey, 
and set H := Hi x • • • x H^- Let moreover a number k > 1, an n-tuple (a^, . . . , a") G H, and 
finite Fi C Hj be given. Then there exist finite Si C Hj with the property that whenever the 
n-tuples in S := Si X ■ ■ ■ X Sm of type tp(a^, . . . , a") are colored with k colors, then there is 
a copy of F := Fi x ■ ■ ■ x Fm in S on which the coloring is constant. 

Proof. We use induction over m. The induction beginning m = 1 is trivial, so assume m > 1 
and that the lemma holds for m — 1. For all 1 < i < n, set c* := {a\, . . . , a^_i). By the 
induction hypothesis, there exist finite Si C Hj for all 1 < z < m — 1 such that whenever its 
n-tuples of type tp(c^, . . . , c") are colored with k colors, then there is a copy of -Fi x • • • x Fm-i 
in 5*1 x ■ ■ ■ X Sm-i on which the coloring is constant. Let p be the number of n-tuples of 
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this type in 5i x • • • x Sm~i- Also by induction hypothesis, there exists a finite Sm,i ^ 
with the property that whenever its n-tuples of type tp(a^, . . . , a^) are colored with k colors, 
then it contains a monochromatic copy of Fm. Further, there is a finite 5*^,2 ^ with the 
property that whenever its subsets of this type are colored with k colors, then it contains 
a monochromatic copy of 5m, i- Continue constructing finite substructures of Em like that, 
arriving at Sm '■= Sm,p- 

We claim that S := Si x ■ ■ ■ x Sm has the desired property. To see this, let a coloring x of 
the n-tuples in S of type tp(a^, . . . , a") be given. Let 6(1), . . . , h{p) be an enumeration of all 
the n-tuples in S*! x • • • x Sm-i which have type tp(c^, . . . , c"). For 1 <i <p and 1 < j < n, 
we write h{iy for the j-th component of b{i) (note that this component is an (m — l)-tuple in 
SiX ■ ■ ■ X Sm-i)- Now for all 1 < i < p, define a coloring of the n-tuples t = (t^, . . . , t") in 
Sm of type tp(a^, . . . , a^) by setting x*(0 •= xi^i'i'Y * i^, • • • , b{i)'^ * t"), where r * s denotes 
the concatenation of two tuples r, s. By thinning out Sm P times, we obtain a copy Fm of 
Fm in Sm on which each coloring is constant with color q^. Now by that construction, 
all n-tuples b{i) have been assigned a color q*, the assignment thus being a coloring of all 
the n-tuples of type tp(c^, . . . ,c"') in x • • • x Sm~i- By the choice of that product, there 
is a copy x • • • x -F^-i of Fi x • • • x Fm-i in x • • • x Sm-i on which that coloring is 
constant, say with value q. But that means that if a tuple {d^, . . . , d") £ F[ x ■ ■ ■ x Fm has 
type tp(a^, . . . , a"), then x{d^j • • • ) '^") = proving our statement. □ 

We now generalize the notion of a transformation monoid to higher arities. Denote the 
set of all polymorphisms of A by Pol(A). Irrespectively of the structure A, this set contains 
all finitary projections and is closed under composition. Sets of finitary functions with these 
two properties are referred to as clones - for a survey of clones on infinite sets, see In 
addition, the clone Pol(A) is a closed subset of the sum space of the spaces D^" , where 
D is again taken to be discrete; such clones are called closed, local, or locally closed (cf. 
the corresponding terminology for monoids before). This means that if a set F of finitary 
functions on a domain D preserves a set of given relations, then so does the smallest closed 
clone containing F, motivating the following extension of Definition [H 

Definition 20. Let D he a set, g : — )• D, and let F be a set of finitary operations on D. 
We say that F generates g iS g is contained in the smallest closed clone containing F. For 
a structure A with domain D and a function / : D, we say that / generates g over A 

iff {/} U Aut(A) generates g. Equivalently, for every finite subset F of A™, there exists an 
m-ary term built from /, Aut(A), and projections, which agrees with g on F. 

As before, finitary functions on ordered homogeneous Ramsey structures generate canonical 
functions, and we can add constants to the language. 

Lemma 21. Let A be ordered homogeneous Ramsey with finite relational signature, and let 
f : A™ — )• A. Let moreover finite tuples ci = {c\, . . . , c^^) , . . . , Cm = (c^i • • • ; cj^") of constants 
in A be given. Then f generates over A an m-ary operation g on A which is canonical as a 
function from (A,ci) x • • • x (A,Cm.) to A and which agrees with f on all tuples (c{^, . . . ,cPm)- 

Proof. We recommend combining Lemma [19] with the methods of the preceding section in 
order to prove this. □ 

The set of all closed clones on a fixed domain D forms a complete lattice with respect 
to inclusion; it is the lattice of all polymorphism clones of structures with domain D. This 
lattice has been investigated in universal algebra (see pO]). 
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Definition 22. For closed clones C, T> on the same set, we say that T> is minimal above C 
iS C C. V and C C. £ C T> implies £ = T> for all closed clones £. Every minimal closed clone 
above C is generated by C plus a single function / outside C; we call such a function / minimal 
above C if there is no function of smaller arity which generates (together with C) the same 
closed clone as /. 

Lemma [21] allows us to find the minimal clones above a closed clone on an ordered homoge- 
neous Ramsey structure. The main difference here compared with monoids is that the arities 
of minimal canonical functions are not bounded a priori, which means that there could be 
infinitely many minimal clones. The following lemma, which has been observed in [5], yields 
a bound on the arities of minimal functions. 

Lemma 23. Let Q be a structure, m > 1, and let R C he a relation which intersects 
precisely m n-orhits of Q. If a function /: 0^ — )• B violates R, then f generates over G a 
function of arity m which violates R, too. 

Proof. Let Oi, . . . , Om be the orbits of Q that are intersect R, and fix arbitrary tuples Sj G Oj. 
Since / violates R, there exist ri, . . . ,rp £ R such that /(ri, . . . , r^) ^ R. Say that bi G Oj-, 
for all 1 < i < p, and choose for all 1 < i < p an automorphism Oi of sending Sj. to 
Tj. The function g{xi, . . . , Xm) '■= /(ai(a^ii), • • • , Oipixip)) has arity m and violates R since 
g{si,...,Sm) = /(ri,...,rp) is not in R. □ 

Proposition 24. Let Q be a finite relational signature reduct of an ordered homogeneous 
Ramsey structure A with finite relational signature. Then there are finitely many minimal 
closed clones above Pol(0), and every closed clone containing Pol(0) contains a minimal one. 

Proof. Let -Ri, . . . , Rn be the relations of 0. If / is a minimal operation above Pol(0), then it 
violates a relation R^. By Lemma [23l it generates over a function of arity o®{ki), where ki 
is the arity of Ri, which still violates Ri. Setting m to be the maximum of the o^{ki) where 
1 < i < n, we get that every minimal clone above Pol(0) is generated by a function of arity 
at most m. By Lemma [211 such functions can be made canonical - the rest of the proof is 
just like the proof of Proposition [TTj □ 

If one wishes to determine the minimal clones above the endomorphism monoid of a struc- 
ture 0, then there is a bound on the arities of minimal functions which only depends of the 
number of 2-orbits of the structure 0, rather than the number of orbits of possibly longer 
tuples as in the preceding proof. 

Definition 25. Let D be a set, and let /: ^ be an operation on D. Then / is called 
essentially unary iff there exist 1 < i < m and F: D D such that /(xi, . . . ,Xm) = F{x-i). 
Conversely, / is called essential iff it is not essentially unary. 

Proposition 26. Let be any relational structure for which o®(2) is finite. Then every 
minimal closed clone above End(0) is generated by a function of arity at most 2 • o®(2) — 1 
together with End(0). 

Proof. Let D be a minimal closed clone above End(0). If all the functions in T> are essentially 
unary, then T) is generated by a unary operation together with End(0) and we are done. 
Otherwise, let / be an essential operation in T). Then one can verify that / violates the 
3-ary relation P3 defined by the formula {x = y) y [y = z). The assertion then follows from 
Lemma [23l the 3-ary subrelation of P3 defined by the formula x = y clearly consists of (2) 
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orbits in Q; similarly, the 3-ary subrelation defined by y = z consists of the same number of 
orbits. Since P3 is the union of these two subrelations, and since the intersection of the two 
subrelations consists of exactly one orbit (namely, the triples with three equal entries), we 
obtain 2 • o®(2) — 1 different orbits for tuples in P3. □ 

Observe that in Proposition l26l if G is a reduct of a structure A, we can also write 2-o^(2) — 1 
for the arity bound if we wish to have a bound which is independent of Q, since A has at 
least as many 2-orbits as Q. 



5. The Algorithm 

We now present the algorithm proving Theorem [TJ the proof of the two statements of 
Theorem [2] is a subset. So we are given formulas (po, . . . ,<j3n over T which define relations 
Rq, . . . , Rn on the domain D of T. Set to be the reduct {D; Ri, . . . , Rn) of T, and write 
R := Rq. We will decide whether there is a primitive positive definition of ii in 0. 

5.1. Operationalization. If there is no such definition, then since is w-categorical, by 
Theorem H] there is a polymorphism / of which violates R; we call / a witness. Our 
algorithm will now try to build a witness. If it fails to do so, then R is primitive positive 
definable in 0; otherwise, it is not. 

5.2. Arity reduction. Let k be the arity of R. By Lemma [23l if there exists a witness, then 
there exists also a witness of arity equal to the number of those fc-orbits in that intersect R. 
This number is not larger than o®(A;), which is not larger than o^{k) since Aut(r) C Aut(0). 
Set m := o^{k); the algorithm now tries to detect a witness of arity m. 

5.3. Ramsey ficat ion. If / is a witness of arity fn, then there are fc-tuples ci, . . . ,Cm G R 
such that f{ci, . . . ,Cm) ^ R- By assumption, F has a first-order definition in an ordered 
homogeneous structure A that is finitely bounded, Ramsey, and has finite relational signature. 
By Lemma [211 / generates over A an m-ary function g which is canonical as a function from 
(A,ci) X • • • X (A, Cm) to A and which agrees with / on all m-tuples whose i-th component 
is taken from the fc-tuple q for all 1 < i < m. In particular, g still violates R and preserves 
0, and hence is a witness, too. Our algorithm thus tries to find a witness of this form. 

5.4. Finite representation. Let n := max(s, n(A), 3), where s is the maximal size of the 
finitely many finite forbidden substructures of A. Since n > n{A), a function from (A, ci) x 
• • • X (A, Cm) to A is canonical iff it is n-canonical. Such functions can thus be represented as 

functions from S^''^^'^ x ■ ■ ■ x S^^'^"^^ to S^. Note that the type space S^^'^^'^ only depends on 
the type of q in A. In other words, if we replace the tuple Cj by a tuple di of the same type 
in A, we obtain the same possibilities of complete behavior. Since o^{k) is finite, there are 
only finitely many choices of types for each Cj - our algorithm tries all such choices (since A 
has a finite relational signature, and is homogeneous, those choices can be made effectively). 
For each choice for the types of the Cj, and for each function a from S^''^^^ x ■ ■ ■ x S'l'^'^™^ to 
S^, the algorithm checks whether a is the behavior of a witness. 
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5.5. Verification. Given a, we verify tlie following. 

• (Compatibility.) If cr is a behavior of a canonical operation, then for all 1 < A; < n 

it must also be extendible to a function from S^^''^^^ x • • • x 5'^'^'^'"^ to S^. This is 
possible in the following situation: if s is an n-type, then it has certain k-subtypes 
t, i.e., projections of tuples of type s onto k coordinates satisfy t. Now products of 
A;-subtypes are automatically sent to a fc-subtype under a: if si, . . . , are n-types 
and / C {1, . . . , n} is a set of size k inducing A;-subtypes ti of Si, then I induces a 
/c-subtype of (t(si, . . . , Sm)- Our algorithm checks for n-types pi, gi, . . . ,pm, qm and all 
I, J ■ ■ ■ ,n} that if / and J induce identical fc-subtypes in pi and qi, respectively, 
then they induce identical A;-subtypes in a{pi, . . . ,Pm) and (T{qi, . . . , qm) - otherwise, 
a is rejected as a candidate. If on the other hand a satisfies this condition, then it 
naturally extends to a function from S^^''^^^ x • • • x respecting arities, 

and we can compute the value of this function for every argument. In the following, 
we write a for this extended function. 

• (Violation.) Since R has a first-order definition in A, and automorphisms of A preserve 
first-order formulas, it follows that i? is a union of orbits, i.e., if a,b are of the same 
type, then a e R iS b e R. Set t := c7(tp(^''=i)(ci), . . . , tp(^''=™)(cm)). Our algorithm 
checks that t is not a type in R, since we only want to accept a if it is the behavior 
of an operation which violates R on ci, ... ,Cm- 

• (Preservation.) For every relation Ri from O, we check that a "preserves" O as follows: 
write p for the arity of Ri . For all p- types ti, . . . ,tm of tuples in Ri , we verify that 
a{ti, . . . , tm) is the type of a tuple in Ri] otherwise we reject a. 

We now argue that the algorithm finds a a satisfying our three conditions if and only if 
there is an m-ary polymorphism of O that violates R. It is clear that the type function of a 
witness will satisfy all the conditions, so one direction is straightforward. For the opposite 
direction, suppose that a is accepted by our algorithm. We build a canonical operation from 
(A, ci) X • • • X (A, Cm) to A in three steps. Let r be the signature of A. 

We first construct an infinite structure 11 with domain D"^ and signature r U {~}, where 
~ is a new binary relation symbol, as follows. This relation is for the proper treatment of 
equality of function values when realizing the behavior a. For all (ai, 6i), . . . , {am, bm) G 
with types ti, . . . ,tm in (A, ci), . . . , (A, Cm), respectively, if the 2-type cr{ti, . . . , tm) contains 
xi = X2 then we set (oi, . . . , am) ~ (&ii • • • ; bm)- Note that since n > 3 and because of the 
compatibility constraints and transitivity of equality, ~ then denotes an equivalence relation 
on D*". The other relations of 11 are defined as follows. Let R he a k-ary relation from 
T. We add the fe-tuple {{a\, . . . , a^), . . . , {a^, . . . , aj^)) relation i? of 11 if and only if 

R{xi, . . . , Xk) is contained in a{ti, . . . , tm), where ti is the type of the tuple {aj, . . . , a^) G Z)^ 
in (A, Ci). Since n > n(A) > k, this is well-defined by the compatibility item of our algorithm. 

The quotient structure 11/^ is defined to be the r-structure whose domain is the set D/^ of 
all equivalence classes of ~, and where R{Ei, . . . , Ep) holds for a p-ary R G t and Ei, . . . ,Ep € 
-D/r^ if and only if there are bi G . . . , 6p € -Ep such that i?(6i, . . . , bp) holds in 11. The final 
step is to show that there exists an embedding / of 11/^ into A. By w-categoricity of A and 
a standard compactness argument (see, e.g.. Lemma 2 in |4J), it suffices to show every finite 
substructure Q of 11/^ embeds into A. This follows from the fact that none of the forbidden 
substructures embeds into O, since n > s, where s is the size of the largest obstruction. 
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Finally, observe that the mapping g from D"^ to D that maps every u in D"^ to f{u/^) 
(where u/^ denotes the ^-equivalence class of u in 11) is a polymorphism of by the preser- 
vation item of the algorithm, and that g violates R by the violation item of the algorithm. 

6. Decidability of Polymorphism Conditions 

In all known cases of structures T with a finite relational signature and a first-order defi- 
nition in a finitely bounded ordered homogeneous Ramsey structure, CSP(r) is tractable if 
and only if there exists a 4-ary polymorphism / of F and an automorphism a of F such that 
for all elements x,y,z of F 

f{x,y,z,z) = a{f{y,z,x,y)) (*) 

One can show that condition (*) describes indeed the frontier between tractability and NP- 
hardness for reducts of (Q; <) and the random graph. It has also been conjectured to be the 
tractability frontier of CSP(F) for structures F with a finite domain |10y21|. 

When F is given by defining quantifier- free formulas over A, and A is given by its forbidden 
induced substructures, then the existence of /, a satisfying condition (*) can be tested by an 
algorithm, by the techniques developed here. A 4-ary operation / satisfies this condition if 
and only if the type function a of f satisfies cr{ti,t2,t3,ts) = 0"(t2, is, ti, t2) for all n-types 
^1)^2)^3 of A, where n > max(n(A), 3, s) and s is the maximal obstruction size of A. 

7. Discussion and Open Problems 

We presented an algorithm that decides primitive positive definability in finite relational 
signature reducts F of structures that are ordered, Ramsey, homogeneous, finitely bounded, 
and with finite relational signature. All of those structures F are w-categorical. While the 
condition for F might appear rather restrictive at first sight, it is actually are quite general: we 
want to point out that we do not require that F is Ramsey, we only require that F is definable 
in a Ramsey structure. We do not know of a single homogeneous structure F with finite 
relational signature which is not the reduct of an ordered homogeneous Ramsey structure 
with finite relational signature. 

Problem 27. Does every structure which is homogeneous in a finite relational signature 
have a homogeneous expansion by finitely many relations such that the resulting structure is 
Ramsey? 

A variant of this problem is the following. 

Problem 28. Does every u- categorical structure have an uj- categorical expansion which is 
Ramsey? 

Note that our method is non-constructive: the algorithm does not produce a primitive 
positive definition in case that there is one. It is an interesting open problem to come up with 
bounds on the number of existential variables that suffice for a primitive positive definition 
of R in O. For many structures F of practical interest, such as (Q; <) or the random graph, 
our algorithm can certainly be tuned so that Exprpp(F) becomes feasible for reasonable input 
size; in particular, the gigantic Ramsey constants involved in the proofs of our results do not 
affect the running time of our procedure. 

Another important open problem is whether the method can be extended to show decid- 
ability of our computational problem for first-order definability instead of primitive positive, 
existential positive, and existential definability; we denote this computational problem by 
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Exprpp(r). By the theorem of Ryh-Nardzewski, first-order definabiUty is characterized by 
preservation under automorphisms, i.e., surjective self-embeddings. But the requirement of 
surjectivity is difficult to deal with in our approach. 

Problem 29. Let A be a structure which is ordered, homogeneous, Ramsey, finitely bounded, 
and has a finite relational signature, and let T be a reduct of A with finite relational signature. 
Is the problem Exprj-Q(r) decidable? 
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